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FOREWORD 



The quality training of leadership and interpersonal skills is of major 
importance to any organization. The U.S. Army has always emphasized the impor- 
tance of training and maintaining strong leadership skills at all levels > es- 
pecially among junior officers. Over the years, various approaches have been 
utilized, most commonly textbooks and simulations (e.g., role playing and as- 
sessment center simulations). These methods have typically been shown to be 
effective means for the assessment and training of interpersonal leadership 
skills. However, both procedures require a large instructor core, including 
role players 9 evaluators, and administrators. 

The Videodisc Interpersonal Skills Training and As/if^asment (VISTA) project 
was conceived as a means to use computers-assisted leadership training to reduce 
the high personnel costs associated with assessment center training and simula- 
tions. Computer-assisted videodisc technology would allow the rapid and accu- 
rate random access to a large number of motion sequences depicting various out- 
comes to given leadership situations encountered by both junior officers and 
subordinates* 

The project was originated by the Army Research Institute's Fort Benning 
Field Unit as a part of a continuing research program dedicated to developing 
better training methods and techniques for teaching soldier skills. ARI over- 
saw the entire VISTA research and development effort. Research support and 
funding during development and evaluation came from the Training Developments 
Institute (TDI) of the U.S. Army Training and Doctrine Command, Fort Monroe. 
The U.S. Army Communicative Technology Office (ACTO) , Fort Eustls, provided the 
equipment and funds for the videodisc production. The U.S. Army Infantry School 
at Fort Benning provided subject mattet experts and students for the evaluation. 
The Training and Audiovisual Support Centers at Fort Benning and Fort Gordon 
provided support during the studio production and editing stages of the project. 

The VISTA project produced nine highly interactive videodisc training 
scenarios covering 20 leadership problems that were judged to be high in diffi- 
culty, importance, and/or frequency. Each scenario can be presented in one of 
two instructional modes designed to maximize the potential of the new training 
technology. In addition, other products were created which were designed to 
expedite future development efforts. 

The evaluation of the scenarios indicated that the videodisc method re- 
sulted in significantly greater learning of leadership principles. Both role 
playing and the videodisc products were rated high on a subjective preference 
scale used to measure user acceptance. Role playing was slightly but signifi- 
cantly higher than videodisc and both role playing and videodisc were much 
higher than a programmed text containing the same instructional content as 
the videodisc. The majority of the students indicated that a combination of 
videodisc and role playing would be optimal for leadership training. 




EDGAR M. JOHITSON 
Technical Director 
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VIDEODISC INTERPERSONAL SKILLS TRAINING AND ASSESSMENT (VISTA) 



EXECUTIVE SUMMARY 



Introduction: 

The U.S. Army's VISTA (Videodisc Interpersonal Skills Training and 
Assessment) project was initiated to determine whether leadership and counsel- 
ing skills could be trained using current computer-assisted instruction/ 
videodisc technology. The target audience was Army junior officers (Second 
Lieutenants in the Infantry Officer^s Basic Course at Fort Benning, Georgia). 
Five government agencies and two contractors were involved in this effort that 
included a front-end topic analysis, hardware selection, software development, 
scenario writing, studio production, editing, videodisc mastering, and final 
evaluation. The final evaluation compared the VISTA products with a program- 
med text containing the same information and role playing using the same topic 
themes. All seven VISTA videodiscs (nine scenarios) were tested. 



Procedure: 

The first stage of the project involved a front-end topic analysis, hard- 
ware and software selection, and design of the instruction. In the topic 
analysis, 57 candidate interpersonal problem situation topics were generated 
and rated by 58 subject matter experts for difficulty, importance, and frequency. 
Situations involving the highest composite scores for the three dimensions 
were subsequently addressed in the training scenarios. Twenty problem 
situations were covered in the 9 scenarios produced to date. The hardware 
system selected comprised an Apple 2+ computer, a DlscoVision videodisc 
player, a Sony monitor and other - assorted peripherals. The software language 
chosen was Pascal. Two instructional modes of presentation were designed. 
The Experiential mode simulates a roleplaying situation. There is no textual 
feedback and the students can go several steps off the ''best path". In the 
Pedagogical mode, extensive textual feedback is presented and the student is 
never allowed to go more than one step off the best path. 

The second major stage of the project involved the scenario writing and 
the software development. A scenario authoring aid was developed. Guidance 
for the determination of appropriate alternatives was derived from the two 
U.S. Army field manuals dealing with leadership and counseling, subject matter 
experts, and various theoretical approaches for counseling and leadership. 
The software was developed to complement the instructional design. In addition, 
software was developed to allow relatively simple entry of textual information 
and videodisc frame numbers to expedite future videodisc development efforts. 

The final stage involved the evaluation of the seven videodiscs (9 
scenarios). An experimental evaluation conducted on all training products 
measured both learning of leadership principles and the student^s acceptance 
of the new instructional technology. 
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Findings : 



The overall results of the evaluation Indicated a VISTA superiority 
followed by role playing and programmed text, respectively, on a test designed 
to measure the acquisition of leadership principles. Also, both role playing 
and videodisc were rated high on a subjective preference scale used to measure 
user acceptance. Role playing was slightly but significantly higher than 
videodisc and both videodisc and role playing were much higher than the 
programmed text. The great majority of the students Indicated that a combin- 
ation of videodisc and role playing would be optimal for leadership training. 



Products completed: 

Nine scenarios which address 20 problem areas have been produced and 
evaluated. Overall results Indicated a significant superiority of VISTA 
products over both role playing and programmed text. 

- Two Instructional approaches designed to optimize the training Impact of the 
new technology. 

- Scenario authoring workbook to aid future scenario writing. 

- Generic software that will control any of the videodiscs developed played 
by either of two popular videodisc players, with or without maintenance 
of detailed student records, and with choice of two Instructional modes. 



Utilization: 

- The VISTA products were Implemented In the Counseling Laboratory of the lOBC 
In June, 1983. 

The following Is recommended: 

- Due to the success of the VISTA project and other videodisc training 
projects, the U.S. Army should continue to Investigate other possible areas 
for application of computer-assisted Instruction/videodisc training. 

Develop standards In both hardware and courseware structure. 

- The VISTA products should serve as a supplement to current leadership 
training approaches rather than a replacement of those approaches. 

- The lOBC Counseling Laboratory Is currently taught In two periods, one at 
the beginning of lOBC and one toward the end. Because of the standardized 
format, role playing should be conducted In the second laboratory as a 
performance test and the VISTA products should be utilized In the early 
laboratory (while students are at an early stage In their learning of 
leadership) . 

- Although the VISTA products were developed for the Infantry Officer's Basic 
Course, the problems addressed are probably common to the other branches. 
Therefore, the VISTA products should be Investigated for possible appli- 
cation In other training centers. 
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Overview 



This final report of the Videodisc Interpersonal Skills Training and 
Assessment (VISTA) project has been structured to allow the reader to go to 
various levels of detail. The report presents general information about how 
the project was developed and evaluated. The various development sections 
address the wide range of topics involved in the VISTA project, from counseling 
theories to hardware selection. The evaluation section reports only the most 
important general findings. The Appendices (published separately) provide 
more detailed discussions of selected areas. The entire report has been 
divided into four volumes. Volume 1 contains the main report. Volume 2 
contains Appendices A - D, which present details of the topic analysis, 
discussions of counseling and leadership theories, and details of scenario 
development. Volume 3 contains Appendices E - J which present the six sceanrios. 
Volume 4 contains Appendices K - II which present details of the software, the 
evaluation instruments, and details of the evaluation results. It should be 
noted that masculine pronouns are used in this report because VISTA was 
designed for a Combined Arms-Infantry population. 



Introduction 

The quality training of leadership and interpersonal skills is of major 
importance to any organization. The U.S. Army has always emphasized the. 
importance of training and maintaining strong leadership skills at all levels, 
especially among junior officers. Over the years, various approaches have 
been utilized from textbooks to simulations (e.g., role playing and assessment 
center simulations). Assessment centers and role playing have typically been 
shown to be effective means for the assessment and training of interpersonal 
leadership skills. However, both procedures have the disadvantage of re- 
quiring a large instructor core, including role players, evaluators, and 
administrators . 

The Videodisc Interpersonal Skills Training and Assessment project 
(vista) was initially conceived as a means to use computer-assisted leadership 
training to reduce the high personnel costs associated with assessment 
centers and role playing (i.e., videodisc programs could be used to supplement 
the current role playing and, hence, reduce the number of support personnel 
required). Historically, the major problem was simulating subordinates as 
they would probably respond in a given leadership situation* An audiovisual 
medium was needed that would allow rapid and accurate random access to a large 
number of video motion sequences depicting various outcomes. Videotape was one 
possibility, but access times were too long for realistic simulations. 
Videodisc technology opened the door for such simulation. 

Previous research has shown that a videodisc system could successfully 
train soldier skills even when only a fraction of the branching and other 
capabilities of the medium were used (Holmgren, Dyer, Hilllgoss and Heller, 
1979-80). Other recent projects have demonstrated the cost and training 
effectiveness of computer assisted videodisc in the Array hardware maintenance 
domain (e.g.. Young & Tosti, 1981). Researchers have attempted to teach 
interpersonal skills using computer assisted instruction (e.g.. Spencer, 
Hausser, Blaiwes, & Weller, 1975). In addition, various projects have 
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attempted to train specialized Interpersonal interaction skills to various 
audiences. For example, vonFeldt (1978) used the DAVID (Digital and Video 
Interactive Device) system with video segments from a videotape source to help 
deaf students prepare for job interviews. Possible applications for training 
medical students have been investigated (e.g., Leveridge, 1980 and 1981). 
WICAT (World Institute for Computer Assisted Training) has produced a video- 
disc designed to teach appropriate interview techniques to medical students. 
Similarly, a videodisc has been produced to help teach California State 
Highway Patrolmen how to handle difficult situations, including Interpersonal 
interactions. The VISTA project represented a test case for the possible 
extension of videodisc training technology into the soft skills areas of 
leadership and Interpersonal skills. Consequently, there were two main goals 
for the VISTA project: to develop meaningful training material to satisfy a 
training need, and to determine the efficacy of using the new technology in 
soft skill areas. 

Development of the VISTA leadership program included the selection of 
hardware; the Identification of the most significant interpersonal problem 
areas for the target population (entry level Infantry officers); designing 
the Instruction In a way that would exploit the capabilities of the new 
technology; writing the scenarios; developing the computer software; and 
finally, the evaluation of all the products. The evaluation involved a series 
of experiments In which each videodisc training scenario was experi- 
mentally compared to role playing and to a low-fidelity simulation of the 
leadership training scenario (progr:^nmed text). The target audience that was 
selected to test and demonstrate t ipability of videodisc for training and 
assessment of. leadership skills wae .cw Infantry second lieutenants in 
the Infantry Officer Basic Course (lOBC). This course represents their first 
leadership course following commissioning. The current method for training 
interpersonal leadership skills is role playing. This requires more than a 
dozen evaluators and the same number of soldiers playing roles to provide 
training for about 90 Lieutenants In a three-hour period. In addition to 
high personnel costs, the effectiveness of role playing is greatly dependent 
on the acting skill of the role player and the ability of the observer to 
provide a meaningful critique. One of the possible advantages of the VISTA 
approach is the introduction of standardized training In an area where standard- 
ization has traditionally been difficult or impossible. 

Three Army agencies, two civilian contractors, and two Army television 
studios worked with the Army Research Institute In the development and 
evaluation of this new technology for interpersonal skills training. The Army 
agencies were: the Training Developments Institute of the U.S. Army Training 
and Doctrine Command at Fort Monroe, Virginia which funded scenario develop- 
ment and evaluation; The Army Communicative Technology Office at Fort Eustis, 
Virginia which provided equipment and videodisc mastering; and the U. S. Army 
Infantry School at Fort Benning, Georgia which provided leadership subject 
matter experts and students for the evaluation. The Lltton-Mellonlcs Systems 
Development Group at Fort Benning, Georgia conducted the topic analysis, 
developed the leadership training flcenarios, integrated the computer and 
videodisc hardware and developed the computer software. They also carried out 
the experimental evaluation of the materials. Video production was done 
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primarily by the Fort Benning Educational Television Branch wilh some assis- 
tance from the Training and Audiovisual Support Center at Fort Gordon, 
Georgia. Videodisc mastering was done by DiscoVision Associates (now Pioneer). 

Topic Analysis 

It was critical for the success of the project that the topics selected 
for the VISTA scenarios be highly relevant and match the needs of the young 
officer. For that reason, a great deal of effort went into the front-end 
topic analysis. A conceptual overview of the entire analysis is presented in 
Figure 1 (page 4). The general strategy was to generate an extensive list of 
potential Interpersonal problem areas and subsequently narrow the list down to 
the eight problem areas which were judged by subject matter experts to have 
the highest aggregate of difficulty, importance, and frequency. To reach this 
goal, a structured interview containing open-ended questions was constructed 
and administered Individually to several officers and NCO's (a copy of the 
interview can be found In Appendix A, Part 1), The Interviews were conducted 
with 18 Army personnel from randomly selected units assigned to the 197th 
Infantry Brigade, Fort Benning, Georgia, Interviewees fell Into the following 
rank and duty assignment categories: six Captains serving as Company Com- 
manders, six Lieutenants serving as Platoon Leaders, two First Sergeants 
serving as First Sergeants, and four Sergeants First Class serving as Platoon 
Sergeants. The Interviews took place during November and December, 1980. 
Before each session, the Interviewees were told the purpose of the Inter- 
view. After this orientation, participants were asked to answer a series of 
questions based on their own experiences. Basically, the interviewees were 
asked to identify critical interpersonal/ leadership situations which a new 
Infantry Second Lieutenant would be likely to encounter on the job. More 
specifically, interviewees were asked to comment on four general areas: 
problems arising from leader- to-subordina te relations, problems arising 
from leader-to-group relations, problems arising from subordinate-to-leader 
relations, and the general area of how to provide the young officer with 
better leadership skills to help him In his early career. 

From the taped interviews, a list of problem areas was generated. In 
addition, 60 hours of taped interviews from the Rumsey and Creskoff (1982) 
study were screened, and relevant situations were added.. The working list of 
critical interpersonal/leadership situations was carefully scrutinized to 
avoid redundancy and over-generalization, and was eventually reduced to a 
draft list containing 87 Items (see Appendix A, Part 2). Because a ques- 
tionnaire composed of 87 Items was judged to be much too long and cumbersome 
to administer, the list was critically reviewed by members of the Leadership 
Department of the United : States Infantry School, Array Research Institute 
personnel, and Litton Mellonics personnel. Any problems which appeared 
redundant were dropped or Incorporated in common problem areas. The result 
was a list of 57 critical situations. 
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Figure 1. Topic analysis. 



Mote : Following the initial structured interviews, a list of 87 problem areas 
was generated and subset^uently reduced to 57 topics in order to remove 
redundancy. Subject matter experts were then asked to rate all problems 
for Difficulty, Importance, and Freq,uency. Finally, the problems were 
rank ordered for: (a) Difficulty, (b) Importance, (c) Frequency, 
(d) Difficulty + Importance, and (e) Difficulty + Importance + Frequency. 
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Using the 57 items, a q.ue8tionnaire vas developed in which subjects vere 
asked to rate each of the situations on a scale of one to seven for difficulty 
(how difficult it is to handle a given problem) , importance (how important it 
is that a given problem be handled veil) , and frequency (hov freaii»'»'*»3-jr a 
given problem occurs). The auept i onnai rp vas -bKcu tiaministered to a group of 
58 Captains and senior First Lieutenants in the Infantry Officer's Advanced 
Course* The complete questionnaire is contained in Appendix A, Part 3, 
Demographic information was also obtained and a summary appears in Appendix A, 
Part I4. 

The resulting top 10 problem areas (derived by a simple summation of the 
three scales for each problem topic) are shown in Table 1 (page 6). Complete 
listings for each of the three scales separately, combinations of Difficulty + 
Importance, and Difficiilty + Importance + Frequency along with detailed analy- 
ses can be found in Appendix A, Part 5» 

Originally the intent at this point vas to use the top eight problem 
areas as the themes for the scenarios. However, upon closer inspection, it 
became apparent that more than eight topics coxild be addressed. More spe- 
cifically, clusters of topics were identified which — with some creative 
writing — could be addressed within a single scenario. A complete list of 
the scenarios along with their respective problem topics can be found in 
Table 2 (pages 7-10). As an example, consider the third scenario (Meeting 
the NCO's and the Platoon). Within that scenario, four specific problem areas 
were addressed (each of which was in the top 10 in Difficulty + Importance + 
Frequency) . It should be noted that in addition to the four topics identi- 
fied, a number of other instructional points were made in this scenario (e.g#, 
company policies on promotions, hov to introduce oneself to the platoon, etc.) 

For each of the general scenario topics, as many specific topics as could 
be meaningfully and realistically covered were included. Thus, many more than 
the originally anticipated eight topics were addressed. For the composite 
scores of Difficulty + Importance + Frequency, nine out of the top ten prob- 
lems and 15 out of the top 20 were addressed. A total of 26 topics were cov- 
ered.* In the following section, the theoretical approach taken for the 
leadership/counseling content of the VISTA scenarios will be discussed. 



Theoretical Approach for Instv actional Content 

In order to determine optimal leadership responses and justification for 
these choices, a number of sources vere utilized. First, the training material 
must be consistent with existing Anny leadership doctrine. The two relevant 
field manuals (FM 22-100 on Military Leadership and FM 22-101 on Leadership 
Counseling) were carefully studied and heavily referenced. Second, retired 
military personnel, active officers, and NCOs within the U.S. Army Infantry 
School Leadership Department were utilized as subject matter experts. These 
individuals were helpfixl in determining the best way to handle a given problem. 



*A total of 26 problem aroi.Ns will be dealt with when all 8 scenario topics 
are completed. This r :.c^rH includes only topics 1-6 and, hence, only 20 
problem areas have becsh ^xcSdressed to date. Ongoing contractual work should 
complete the last tvc /^ario topics by mid-198i*. 




19 



Table 1 



Difficult + Important + Frequent Interpersonal Situations 

Rank ^^^^ 
Order Nu^nber 

1 The NCO will insure that the individual arms and equipment of sub- 55 
ordlnates, and all other govemtnent property issued to the Platoon 

is properly maintained and accounted for at all times. 

2 The NCO is responsible for preparing subordinates to accomplish 53 
assigned missions by training subordinates in basic skills and 
attributes of a soldier, 

3 The NCO will be held accountable for the location and actions of 54 
subordinates while in a duty status* 

4 A Plat ton Leader giving his new Platoon Sergeant an initial briefing 9 
on how he expects the platoon to function* 

5 The NCO is responsible for insuring that subordinates maintain 56 
established standards of personal appearance and hygiene, proper 
wearing of the uniform, and of military courtesy. 

6 The NCO will supervise the care and maintenance of enlisted per- 57 
sonnel billets and unit work areas. 

7 A Lieutenant counseling a Sergeant who has failed a series of 1 
unannounced inspections* 

8 The wife who cannot accept, or does not understand Army life. 38 

9 A soldier who receives letters of indebtedness because bills are 29 
not paid on time or neglected completely. 

10 The wife who Is lonely or homesick because the husband is gone on 37 
training exercises frequently, works late, or pulls a lot of roster 
type duties. 



EKLC 



20 



Table 2 



Scenario Topics 



Topic 1: Verbal Abuse 

DI FP + IMP + FREQ 

#38 



Topic 2: Taking Charge 

PIFF IMP + FREQ 



The wife who cannot accept, or does not 
understand Army li£e» 

A Platoon Leader counseling a Sergeant who 
verbally abuses and belittles soldiers in 
front of other platoon or squad members. 



A Platoon Leader giving his new Platoon 
Sergeant an Initial briefing on how he 
expects the platoon to function. 



Topic 3: Meeting the NCO's and the Platoon 



PIFF IMP 4- FREQ 

n 



n 



The NCO will insure that the Individual 
arms and equipment of subordinates, and all 
other gove rnme nt property Issued to 
the Platoon Is properly maintained and 
accounted for at all times* 

The NCO la responsible for preparing 
subordinates to accomplish assigned 
missions by training subordinates in basic 
skills and attributes of a soldier. 

The NCO will be accountable for the 
location and actions of subordinates 
while in a duty status. 

The NCO will supervise the care and 
maintenance of enlisted personnel billets 
and unit work areas* 
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Table 2 



Scenario Topica 
(continued) 



Topic A: Perfonrance Counseling an NCO 



DIFF + IMP + FREQ 

#7 A Lieutenant counseling a Sergeant who has 

failed a series of unannounced Inspections. 



Pl5 A Platoon Leader counseling a Sergeant 

whose platoon has failed to pass a training 
exercise* 

Ifn A Platoon Leader counseling a Squad Leader 

who will not accept responalblHty for his 
men and/or his equipment* 

iS^19 A Lieutenant counseling a Sergeant who has 

failed to have his men and equipment report 
on time for a support requirement* 

4 

Topic 5: Insubordination 



DIFF + IMP + FREQ 

fS The NCO is responsible for insuring that 

subordinates maintain established standards 
of personal appearance and hygiene, proper 
wearing of the uniform^ and of military 
courtesy* 

#21 A Platoon Leader counseling an Enlisted 

Soldier who has repeatedly failed to show 
up for work on time* 

#26 A Lieutenant counseling an Enlisted Soldier 

who is insubordinate* 



#27 A Platoon Leader counseling an Enlisted 

Soldier who disappears during duty hours* 
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Table 2 



Scenario Topics 
(continued) 



Topic 5: Insubordination (Continued) 
DIFF + IMP FREQ 



M4 



f?45 



Topic 6: Personal Crises 

DIFF -f IMP + FREQ 

m 



m 

Topic 7: Financial 

DIFF -f IMP FREQ 

^13 



The Soldier who openly begins to disobey 
any order given him. 

A Platoon Leader counseling an Enlisted 
Soldier whose personal appearance in 
falling below standards* 



A Soldier who needs to go on emergency 
leave • 

The Soldier who normally is very social 
with his peers and supervisors, and 
suddenly becomes very withdrawn, extremely 
quiet 9 and depressed. 

A Soldier mumbling about suicide. 



A Soldier who receives letters of indebted^ 
ness because bills are not paid on time or 
neglected completely. 

A Soldier unable to balance a checkbook, or 
who writes bad checks. 
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Table 2 

Scenario Topics 
(continued) 



Topic 8; EER Counseling 

PIFF -^ IMP -f FREQ 

m 



A Platoon Leader counseling an Enlisted 
Soldier about his EER. 

A Lieutenant counseling a Sergeant whose 
personal appearance is starting to slip 
below standards. 

A Platoon Leader counseling an Enlisted 
Soldier who has done an outstanding job on 
a training exercise* 

A Platoon Leader counseling an Enlisted 
Soldier whose poor performance on a recent 
training exercise was easily recognizable. 
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Because of their experience with Junior officers, they were also extremely 
valuable in identifying incorrect choices and consequences which frequently 
occur in the field ♦ Another valuable human resource was the subject matter 
experts available within many different Army agencies. For example, the staff 
at the Judge Advocate General Office was very helpful in advising about legal 
implications for the insubordination scenario. Similarly, the Red Cross, the 
Army Community Services, and the Community Mental Health Center all willingly 
provided useful suggestions and information. 

A third source of input for generating behavioral alternatives and their 
positive or negative feedback was the rather extensive theoretical counseling 
literature. Obviously, the goal of the VISTA project was not to make polished 
therapists out of Second Lieutenants in three hours of instruction. However, 
the various counseling approaches do offer valuable guidelines and tested 
principles which could be useful to a beginning counselor. Also, the new 
leader should be able to recognize problems at an early stage of development, 
be aware of the various sources of expert counseling that are available in 
the Army structure, and refer complex problems that require more expertise to 
the appropriate agency or person. 

A fourth source of theoretical information considered was the various 
leadership theories. As in counseling theories, the intent was not to make 
a theorist out of the Second Lieutenant, but rather to take empirically sup- 
ported principles and applications from existing leadership theories and 
present them as solutions or as a Justification for a solution in a way that 
was easily understood. 

Finally, facts from many other well-established disciplines were incor- 
porated into the alternatives or feedback where appropriate (e.g., communica- 
tions, learning and motivation, decision theory, cognitive theory, management 
theory, and social psychology). Two of the five sources of information 
(counseling theories and leadership theories) , deserve further explication 
and, hence, are expanded in the following two sections. Also, much more de- 
tailed discussions of counseling and leadership theories are provided in 
Appendices B and C, respectively. 

Counseling Theories 

The purpose of this section is not to provide detailed theoretical ac- 
counts of the major counseling theories. Such accounts are available at 
Various levels of discourse varying from the original source to excellent 
texts giving overviews of the various approaches. Also, a brief review of 
selected theories can be found in Appendix B. 

On the basis of the two Army Field Manuals, a Counseling Decision Tree 
was constructed (see Figure 2, page 13). This decision tree doesn^t appear 
in either Field Manual or in any of the VISTA scenarios. Rather, it was con- 
structed to be consistent with doctrine and provide guidance to the scenario 
writers. When referring to "problems" in Figure 2 or in the following dis- 
cussion, reference is being made to only the problems that a Second Lieutenant 
might encounter which are of a leadership/counseling nature and that involve 
interpersonal skills as part of the solution. 
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The original detection of a problem may come as a result of personal 
observation, reports from the Individuals experiencing the problem, reports 
from a subordinate about another subordinate experiencing a problem, or 
reports from a superior. In any case, for the purpose of Army counseling, the 
problem Is likely to fall primarily Into one of three categories: performance 
problems, personal problems, or career problems. The three problem areas are 
not mutually exclusive, and In most cases, more than one of the problem areas 
are likely to be present. In such complex problems, the performance component 
Is probably the most quickly and efficiently handled. That Is, where there Is 
a performance problem. Immediate "on the spot" correction should be given as 
soon as possible. Depending on the magnitude, frequency, and circumstances, 
the leader should probably go one step farther and try to assess the reason 
for the performance problem. If there Is an ability problem (either physical 
or mental), then additional training or reclassification are probably the best 
alternatives. If there Is a motivation problem, then the leader should make 
use of any existing Incentives and/or clearly Inform the subordinate of the 
consequences of continued poor performance. If there Is some personal problem 
at the root of the poor performance, then that personal problem should be 
attacked as soon as possible. Similarly, If there Is a career crisis causing 
the performance problem, then career counseling should be made available as 
soon as possible. 

If a personal problem Is encountered, one of the main decisions the 
Second Lieutenant has to make Is whether to refer the Individual to one of the 
many Army agencies available, or whether he/she should attempt to counsel the 
Individual. If the problem Is personality-based, too difficult, too time- 
consuming, or more easily handled by another agency, then the Individual 
should be referred to the appropriate agency. If the problem Is more envir- 
onmentally based, the Second Lieutenant should probably counsel the Individual 
and attempt to resolv«^* the situation by providing the necessary Information 
and/or obtaining authority to effect a solution (e.g., get the Individual a 
pass). In any case. If the situation becomes too difficult or time-consuming, 
the Second Lieutenant should probably refer the Individual to an appropriate 
agency. If the Individual has career-related problems, the Second Lieutenant 
should provide the necessary Information as It Is available or else refer the 
Individual to an Army career counselor. 

The essential Ingredient for success along any of the above paths Is the 
ability to Interact effectively with other people. As stated above, the 
purpose of the VISTA project was not to make counselors or therapists out of 
Second Lieutenants In a three or four hour period of Instruction. Rather, 
the purpose of VISTA was to teach the student some commonly accepted prin- 
ciples about how to Interact with others In a way that will Improve the 
problem situation and expedite Its resolution. For this reason, the various 
counseling theories were studied, not with the goal of picking the "best" 
theory, but rather to collect general principles from the various approaches 
which were commonly agreed upon, easily explained, and would be useful to a 
new counselor. 

Most counseling approaches are descendants of various therapeutic 
approaches. Therapy Is usually conducted by psychiatrists, or psycholo- 
gists, over an extended period of time, and usually Involves more complex 
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personality-based difficulties. There are many ways of categorizing the 
various theoretical approaches. Selection of a single approach would have 
been untenable because even the most expert counselors and therapists disagree 
among themselves about the best approach. For example, one major distinction 
that can be made between different approaches is whether they are directive or 
nondirec tive. Directive therapies and counseling approaches ( e.g.; Rational 
Emotive Therapy, (Ellis, 1962); Reality Therapy, (Glasser, 1965); Gestalt 
Therapy, (Perls, 1958); and the various Behavior Modification approaches of 
Wolpe, 1973; Krumboltz, 1969; Ullman and Krasner, 1969; Bandura, 1965; and 
others), typically emphasize the role of the therapist/counselor as a more 
authoritarian professional who strongly guides and determines the direction of 
the therapy/counseling session (i.e., the therapist is directive). On the 
other hand, nondirective approaches (e.g., Client-Centered Therapy, (Rogers, 
1942, 1951); Logotherapy, (Frankl, 1963); Helping Counseling, (Carkhuff, 
1969); and many of the various Existential Approaches of Keirkegaard, 19AAi 
May, 1953; Tillich, 1952; and others), stress the importance of the client/ 
counselee in the relationship. The counselor's main goal is -to set an accept- 
ing, understanding atmosphere in which the client/counselee can gain accept* 
ance, understanding, empathy, and can therefore grow. The Army Officer, by 
the very nature of his or her position, should obviously not be locked into 
either of these general counseling modes. Depending on the situation, the Army 
Officer must at times be very directive (e.g., in performance counseling 
situations), and at other times should be nondirective (e.g., during some personal 
counseling situations or during some career counseling situations). For that 
reason, the VISTA strategy was to teach flexibility. Depending upon the 
situation, various approaches were introduced as appropriate. In general. 
Behavioral approaches were stressed in situations involving performance 
counseling because of the behavioral component. However, students were urged 
to look deeper for more subtle motives and conduct personal counseling if 
appropriate. In personal counseling, many approaches were tapped, but the one 
most utilized was Carkhuff's Helping Counseling Approach because it is 
relatively intuitive, it was designed for counseling (as opposed to therapy), 
and there is empirical evidence indicating that it could be relatively easily 
understood and applied by a layman population (see Carkhuff, 1969). 



Leadership Theories 

Like the counseling theories, the various leadership theories have 
different origins and orientations (see Appendix C for a more 
complete overview of the various theories). Also, as in the Counseling 
Theories, it would be untenable to select a single theoretical approach for 
Army leadership as the best approach. A similar conclusion was recently made 
by Henriksen, Jones, Hannaman, Wylie, Shiver, Hamil, and Sulzen (1980). 
Therefore, as in Counseling, the approach was to selectively draw principles 
from the various theories as they appeared relevant and applicable in the 
various VISTA situations. Since the primary purpose of the VISTA project was 
the training of leadership, a few of the historical theoretical approaches 
were not particularly relevant because they deal principally with descriptive 
information concerning the prediction of leaders (e.g., the Trait Theory of 
Galton (1879), and Carlyle (1910); the Environmental Theory of Stogdill, 1948 
and Hemphill, 1949; and the Empirical Approach of the Ohio State work group, 
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e.g., Stogdlll and Coons, 1957). Many contemporary theories can somftwhat 
arbitrarily be divided Into two clusters. In general, humanistic theories 
(e.g., McGregor, 1960; Blake, Mouton, & Bidwell, 1962; and Bowers & Seashore, 
1966) emphasize the Importance of creating an environment In which the 
Individual can fulfill his/her own potential while contributing to the organi- 
zation's objectives. The role of the leader Is to modify the typically 
structured organization to one that allows naturally motivated Individuals to 
grow and reach their potential (Stogdlll, 1974). 

A second cluster of theories might be called Leader-Situation theories 
because they tend to emphasize the interactions between leader and situational 
characteristics (e.g.; Contingency Model, (Fiedler, 1967); Path Goal Theory, 
(House & Dressier, 1974); Decision-Making Model, (Vroom & Yetton, 1973); 
Jacob's Social Exchange Theory, (Jacobs, 191 h) i Life cycle Theory, (Hersey «= 
Blanchard, 1977); Behavioral Theory, (Yukl, 1971); Power Theory, (McClelland, 
1975)- Vertical Dyad Linkage Approach, (Graen, Dansereau, & Minami, 1972); and 
Developmental Model of Leadership, (Sgro,, Pence, & Orban, 1979). In general, 
these various approaches identify an impoi-^tant leadership characteristic (or 
characteristics) and systematically address how these characteristics Impact 
on leader effectiveness over various situations. It should be noted that most 
of the theories listed above are not necessarily in conflict with each other. 
EUither, each has selected a given dimension for emphasis. In using the 
various leadership approaches as references for the VISTA project, various 
principles were applied as they fit the situation. In no case, was an 
elaborate theoretical explanation given. The purpose of VISTA was not to 
teach theoretical approaches. Rather, the intention was to teach easily 
comprehended and easily remembered principles which have their roots in more 
elaborate theoretical structures. 



Instructional Design 

The original intent of the VISTA project was to simulate an interpersonal 
interaction that represented an actual leadership situation that a young 
officer would probably encounter. The fast random access to video segments 
that the computer assisted videodisc provides, allows such simulation. For 
example, given a trainee's response in a particular situation, the videodisc 
system can quickly show the subordinate's probable reaction which will 
provide the trainee with immediate and realistic feedback about whether that 
choice was the best, or less than optimal. Because of the simulation nature 
of this mode of instruction, it was labeled "Experiential". Because of the 
difficulty in writing scripts that fully portray and explain some of the more 
subtle principles and teaching points that should occur in an interaction, it 
was decided to develop a second instructional mode that would similarly 
exploit the capabilities of the technology but would provide more detailed 
feedback about the principles being taught. Because of its high structure 
and heavy use of tutorial feedback, this mode of instruction was labeled 
"Pedagogical". 
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Experiential Mode 



In the typical Experiential training situation, a new junior officer 
leadership trainee sits before a television monitor and holds a light pen 
or game paddle that will allow a direct Interaction with the TV monitor and 
thus, the computer. Typically, the computer initiates the session by presenting 
background information on the monitor that sets the stage for the actual 
problem situation. Next, the videodisc player presents a video segment that 
Introduces the problem situation. This might Involve a member of the platoon 
who has financial problems or a NCO who has been verbally abusing members of 
his squad. For example, the person with the problem might be seen on the 
screen entering the Lieutenant's office or approaching the Lieutenant In a 
field setting. The televised subordinate typically begins the interaction 
speaking directly to the viewer. Following the initial comment by the 
simulated subordinate, the leadership trainee Is shown a menu of possible 
responses that a Lieutenant might make In that situation. Each alternative 
was carefully chosen by scenario developers to appeal to a segment of the 
trainee population (see the section on Scenario Development and Production). 
However, some of the responses are more appropriate than others. The trainee 
rev js these alternative responses and chooses the one that he believes to be 
the i^est. Using the light pen, he informs the computer of his choice by 
touching that alternative. Immediately, the simulated subordinate reacts as 
he probably would if treated in the manner that was selected. When the video 
segment depicting thia simulated subordinate is complete, a new menu of possible 
responses to the current situation appears on the screen and the trainee 
selects a response for the updated situation. 

In the Experiential mode of Instruction, Interactions continue between 
the leadership trainee and the simulated subordinate for as many as 10 ex- 
changes until the situation is resolved for better or worse. In the latter 
case, the subordinate might be last seen bolting away from the Lieutenant 
muttering about incompetent Second Lieutenants. Presumably, these interactive 
scenarios with their rapid branching will cause trainees to react and respond 
to the simulated subordinate in much the same way that they would respond to a 
real subordinate. Realistic consequences of these leader responses are the 
feedback. Hopefully, this approach to Interpersonal skills training will 
provide a potent tool for training leader skills which, unfortunately, are now 
learned by trial and error on the job (see Rumsey and Creskoff, 1982). In the 
Experiential mode, the videodisc scenarios also provide trial-and-error 
leamilng, but the errors do not have "real life" negative consequences for 
either the counselor or the counselee. 



Pedagogical Mode» 

The instructional design for the Pedagogical mode Is presented in 
Figure 3 (page 18). The student is originally given some background Infor- 
mation. The background information contains only as much information as is 
necessary for the completion of the scenario. In the VISTA project, all text 
(e.g. background information, questions, answers, feedback, etc.) is presented 
on the monitor from a computer source. The reason for using the computer as a 
text source rather than having text stored as single frames on the videodisc, 
is that flexibility was desired. Wording changes for questions, answers, and 



mparts of this section were taken from Schroeder, 1982. 
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feedback can be easily made in the computer softvare, but can never be made 
once placed on a videodisc. 

After receiving the background information , a short video segment is 
presented "^rom the videodisc source. The vidou segnient 6et3 the stage for the 
first choice (e.g., a Sergeant reports a discipline pcoblcoi and asks the 
Lieutenant what should be done). Following the video scigment, the Trainee is 
asked to write down what he would say in that sltuatloa* This step was 
Included so that the Trainee would be allowed to pro::tlce constructing a 
response. Following the completion of the construci;ed response, the Trainee 
Is presented a response menu and asked to select the alternative that is the 
most similar to his constructed response or that Is the best option of those 
presented. Once a respoi:so Is selected, the Trainee Is shown a video segment 
from the videodisc that depicts that choice. In this video segment the camera 
Is on the Lieutenant so that the Trainee can see the effect of a particular 
response from the subordinate's perspective. The video segment portrays the 
chosen response only and stops before any feedback from the subordinate can 
clue the Trainee about the adequacy of the choice. The reason that the 
Trainee is given a preview of what the choice looks like when enacted is to 
prevent any discrepancies which might occur between the words of a choice when 
read and those same words acted out. For example, think of the various 
meanings that could be acted out with the words "I think you did just fine." 
After seeing the words acted out, the Trainee should have a much better Idea 
of the Intended meaning. The Trainee is next asked whether or not he wants to 
keep the response. If not, he Is returned to the response menu. In this 
manner, it is possible for the student to preview every choice before keeping 
one. There are two additional reasons for showing the Lleutenant^s actions in 
this video segment. First, if the camera were on the subordinate at this 
point, the subordinate's facial expressions or body language might serve as 
feedback regarding the effectiveness of a particular response. Second, by 
pairing a model's actions with feedback about their correctness, the Trainee 
will hopefully learn which styles of behavior to emulate. 

After the student has selected and kept a response, he is immediately 
shown a video segment that again depicts that answer, but this time It is from 
the Lieutenant's perspective. Also, the Trainee Is shown the subordinate's 
probable reaction to that response. Besides providing feedback to the Trainee 
about his last choice, the subordinate's reaction Is carried to the point that 
a new decision point Is created. Thus, the subordinate's video segment serves 
as a "conclusion" to the prior choice point and a "lead In" for the next 
decision. If the scenario Is well written, the subordinate's reaction will 
convey some information about whether that response was good or poor. However, 
to insure that the subtle teaching points are communicated, the student is 
next given some very specific feedback (e.g., This answer was probably not the 
best for the following six reasons:, or. This answer was judged to be the best 
for the following five reasons). The feedback statements are typically based 
on principles of Counseling, Leadership, Management, Communications, Learning, 
Social Psychology, etc. The main principles to be taught were decided 
before and during the scenario writing. It was, therefore, the Instruction 
that drove the scenarios and the technology rather than the other way around. 
If the response chosen was not the best, the student is given appropriate 
feedback and then returned to the response menu. If the response chosen was 
the best, the student Is given appropriate feedback and then given the oppor- 
tunity to learn vhy the other choices were less than optimal, or otherwise 
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proceed with the interaction. Should he choose the former, he is again 
presented with the response menu and can select the video and textual feedback 
for any or all of the remaining choices. The student must make the correct 
choice before he can continue with the interaction. Also> the student is 
never allowed to go more than one step off the best path. 

The procedure described above repeats in cyclic fashion until the inter- 
action reaches some closure. It should be noted that the subordinate's 
reaction to the best choice plays a double role: (a) it provides feedback 
about th^. appropriateness of the last choice, (b) it serves as a transitional 
lead-in to the next choice point. 

Mo of the instructional features found in the Pedagogical Mode are 
found i' .nost computer assisted instruction applications (e.g., immediate 
feedback., branching, etc.). These principles come from well established 
principles of learning. There are five novel features which contribute 
greatly to the learning environment in the present application. First, the 
inclusion of the constructed response in addition to the fixed alternative 
choices allows the student to practice originating a response within the 
otherwise structured format of CAI. This attribute keeps the student active 
in the learning situation and is claimed to be extremely important in programmed 
learning (e.g., Skinner, 1958). In addition, the constructed response adds 
variability to the response mode which is apparently important in maintaining 
the student^s interest (Gardner, 1979). The potential danger in using this 
procedure is that a student might construct a response that is substantially 
different from the subsequent fixed alternatives. In such a situation, the 
student could conceivably never receive feedback on the constructed response. 
To prevent this. It would be desirable to have a laboratory proctor available 
for further explanation* 

A second novel feature is the provision of a "preview" of the answer 
selected. The reason for the novelty, of course, is that in most CAI appli- 
cations, providing the student with a preview of what the response looks like 
would be unnecessary, impossible, or would provide the student with the 
answer. However, there are two very good reasons for including the preview in 
the present interpersonal skills training appli*--* tion. First, it is important 
that the textual-behavioral discrepancies be removed in order that students 
don^'t believe they have been misled. Second, the preview allows the student 
the unique opportunity of seeing what a surroga te-self looks like while acting 
out the various alternatives. By pairing behavioral portrayals with subsequent 
explicit feedback, the student has an opportunity to model and leaini appropriate 
behavior. Also, the student can witness less than optimal performance and 
discern why it was not the best. In this way, the Trainee can objectively 
scrutinize the incorrect response without the def ensiveness that might occur 
if, for example, he saw a videotape of himself making the same error. 

The third significant inclusion is the option of studying the other 
(incorrect) alternatives after successfully completing a choice point. The 
student may have been torn between the correct choice and one or more dis trac- 
tors and may have arbitrarily selected the best choice. In such a situation, 
the Trainee would probably get feedback about why that alternative was the 
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best, but under many conventional instructional modes, he would leave the 
situation never really understanding (or being exposed to) the reasons that 
the other choices were not the best. Of course, arguments about whether 
students should be allowed to make, study, or dwell on incorrect options may 
be appropriate here (e.g., Skinner, 1968). However, while such arguments are 
appropriate in some learning tasks in which there is nothing to be learned 
from making the wrong response except the wrong response, they may be less 
appropriate in this situation where layers of explanation and feedback are 
added to facilitate understanding why the response was not the best. 

A fourth significant feature of the present design is the fact that 
precise feedback is delivered immediately following a response. In most 
conventional interpersonal skills training approaches (e.g., role playing), 
feedback is delivered only at the conclusion of the entire interaction. The 
interaction would be interrupted if the instructor wished to give immediate 
feedback. After the interruption, it would be difficult to recreate the 
situation prior to the interruption. This interruption problem is also 
present with the Pedagogical design, except that the student can choose 
the option of looking at the prior sequence again in order to refresh the 
si tua tion. 

A fifth important feature of the current design is the mere presence of 
the textual feedback. In applied areas such as interpersonal skills training, 
reasons for behaving or not behaving in certain manners range from being 
clearly stated to being vaguely stated (depending on the skills of the 
instructor). The simple requirement of feedback in the scenario keeps the 
scenario writers honest in the sense that they must be able to state clearly 
why action A is better than action B. Hence, action A and B as well as their 
feedback are open to the scrutiny of both the student and other professionals 
for their agreement or disagreement. This feature leads to two important 
consequences. First, scenario writers must put a great deal of thought into 
the script and feedback because of the specificity required. Second, the 
requirement of specific feedback brings standardization into a content area 
where standardization has traditionally been difficult. The pedagogical mode 
can be thought of as a standardized role playing situation. Also, the visible 
feedback forces scenario writers, instructors, and theorists to clarify and 
operationally define their views. This process may help distinguish areas of 
theoretical agreement and/or disagreement. 



Scenario Development and Production 

The major objective of the VISTA project was to determine whether the new 
computer assisted videodisc training technology could train leadership skills. 
Regardless of the sophistication of the hardware and software involved, the 
success or failure of any training system is still probably determined by the 
quality of the content material. For this reason, a great deal of effort 
was put into scenario developmc-nt. In addition, regardless of how tutorial, 
creative, and insightful the written scenario may be, the translation from 
script to actual production must be of high quality in order to deliver a 
final product that is realistic, interesting, doctrinally accurate, and 
instructional. 
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An overview of the scenario development is shown in Figure 4 (page 22). 
After the topics for a given scenario had been determined (see section on 
Topic Analysis), the next step was to establish a realistic situation (time, 
place, characters, etc.), in which a given problem would be likely to occur. 
Also, it is Important at this early point to establish the primary instruc- 
tional objectives. These objectives were determined by consulting with 
subject matter experts (SME's), checking Army doctrine, and checking any other 
relevant sources of information (e.g., theories, referral agencies, etc.). A 
complete list of the major instructional objectives can be found in Appendix 
D, Part 1. It is important for the scenario writer to remember two things 
as he/she proceeds through the subsequent stages. First, the items listed 
should be included in the scenario if at all possible. The second point is 
not as obvious. The scenario writer should not feel compelled to limit the 
instruction to those a priori objectives. It is impossible to know what 
additional instructional points will evolve as the scenario progresses. For 
that reason, the original list should be considered as an initial list to 
which additional instructional polats can be added as the writing evolves. 

The next step is to create the ideal linear correct path. That is, the 
writer must write a dialogue between the counselor and counselee that is: (a) 
realistic; (b) contains all of the original objectives plus any that evolve; 
(c) resolves the problem situation to the extent that a Second Lieutenant can 
resolve it; and (d) is consistent with doctrine, theory and the SME's. This 
diaJogue will represent the correct path for the scenario. 

After the correct path has been determined, the next step is to carefully 
examine each of the Counselor's (Second Lieutenant's) responses and, with the 
help of the SME, doctrine, etc., determine if each is a point in the inter- 
action that is critical, necessary for the correct resolution of the problem. 
Involves one of the teaching objectives, and/or is a point where mistakes are 
commonly made. If a response satisfies one or more of the above conditions, 
then that part of the dialogue becomes a prime candidate for a choice point 
and the Lieutenant's statement becomes the correct alternative for that 
choice point. Next, the specific feedback for the Pedagogical Mode should be 
created. As stated above, writing the feedback has the desirable effect of 
keeping the writer honest (i.e., insuring that there is substantial justi- 
fication for a correct choice). Writing feedback also provides another useful 
function in the scenario development. If there is insufficient feedback 
for a given choice, the choice point should be questioned. 

After choice points and correct feedback for the correct alternatives 
have been determined, the next step is to create Incorrect alternatives 
for each of the choice points. These alternatives should be realistic and 
commonly made mistakes. Along with the alternative, the counselee' s most 
probable response should be written. This reaction should, if possible, 
depict an undesirable outcome so that immediate video feedback can indicate a 
less-than-optimal choice has been made. Also, feedback for each of the 
Incorrect choices should be written that clearly states what was wrong with 
that alternative. At this point, the scenarist should also be identifying 
negative resulting consequences or end points which could develop as a result 
of a given Incorrect response. When the above steps have been completed, the 
Pedagogical scenario is complete. 
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To complete the Experiential scenario, the writer must addron* V'-:xch 
incorrect alternative on the correct path as a new situation J, » lautsc 
identify a possible negative outcome or end point that could o-or.r U I he 
student were to persist in the wrong direction, and dialogue that Lakes the 
trainee to that end point. The writer should then identify potential choice 
points along that incorrect path and alternatives for those choice p' mrr.. If 
possible, one of the alternatives at each choice point should allow Iho 
student to get back to the correct path and salvage the situation. For 
purposes of economy, a given incorrect path should probably never go more than 
three choice points off the correct path and various incorrect paths should be 
channeled into common undesirable end points If these suggestions are not 
followed, it could mean that the video segments might not fit on one videodisc. 
Of course, the final step is to submit the finished written scenario to the 
appropriate approving agency before production. 

In order to facilitate future scenario writing, a Scenario Authoring 
Guide was created. This guide provides an outline and checklist for new 
scenario writers so that they can quickly proceed with scenario writing rather 
than recreating a scenario writing strategy that has already been developed, 
tried, and successfully tested. The Scenario Authoring Guide can be found in 
Appendix D, Part 2 and Scenarios 1-6 can be found in Appendices E-J. 

After scenario approval and appropriate actors have been selected, the 
Production and Editing stages begin. It is very important to work closely 
with the production people from the onset. The Director should be given 
copies of the scenario well in advance of the actual shooting. Also, the 
scenario writer should go through the entire scenario with the Director to 
explain any desired mood, affect, etc. which may not be obvious in the text. 
The scenario should then be transformed into a production script by removing 
irrelevant material (choice point alternatives, feedback, etc.), inserting 
appropriate prompts for the Director and actors, and dividing the scenario 
into relatively short scenes. The scenes should be selected so that they run 
continuously from a given alternative at a choice point up to the next choice 
point or end point, whichever is next. The reason for flowing from one alter- 
native to the next is that although videodisc edits can be conducted during 
the actual training, such edits are choppy and disrupt the flow of the 
ins truction. 

During the shooting, two cameiTas should be used simultaneously. One 
camera should be positioned so that it is facing the counselee (i.e., so that 
later, in the training setting, the trainee sees what he would if he were 
actually there talking to the counselee). The counselee should look into that 
camera when talking rather than looking at the actor who is playing the 
Second Lieutenant. Similarly, the second camera should be positioned in a 
similar fashion except facing toward the Second Lieutenant Counselor. Shots 
taken from the second camera will be used to show the student what a given 
response looks like. On opening and closing scenes, it proved beneficial to 
have a third camera taking a wide angle shot of the set. This was effective 
in establishing the situation and providing closure. Concerning sequence of 
shooting scenes, it is helpful to shoot scenes on the correct path first. 
Subsequently, it is helpful to shoot scenes along a given wrong path in 
correct sequence. This strategy helps everyone keep track of the appropriate 
mood, etc. 
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The scenario writer should bo present during all shooting for three 
reasons. First, he/she must review each scene to Insure that the right 
message was conveyed. Second, he/she must check to see that each scene has 
been Included. Third, he/she must make sure that scene transitions flow 
smoothly. Given the heavy use cf branching and the resulting Impossibility of 
shooting scenes In true sequential order, this task Is often a difficult one. 
To accomplish this, the scenario writer and director must often recreate 
earlier scenes or replay the appropriate tape If possible. In addition to the 
Director and Scenarist, tt Is desirable to have a military SHE present to make 
sure that the acting carries the appropriate military bearing and to insure 
that uniforms, etc. are In accordance with military doctrine. 



Technology Application 

Hardware 

The selection of the hardware started with the design of an ideal system 
to be used in the project. That is, the ideal system was designed and 
hardware was selected to implement, as closely as possible, the ideal system. 
This system was to consist of an industrial version, laser reflective optical 
videodisk player; a NTSC color monitor; a microprocessor (and floppy disk 
drives) that had a NTSC compatible text generator; a real-time clock; a 
videodisc interface card; and finally, a touch-panel for the monitor. Such a 
system would permit text from the computer or scenes from the videodisc player 
to be displayed on the monitor and would also permit a student to Interact 
with the system by touching the monitor's screen. The latter capability would 
guarantee that the system would be easy to use. 

A laser reflective optical videodisc player was chosen because it 
would permit rapid (under five seconds) access of any motion sequence stored 
on the videodisc. Because a laser beam is used to read the information from 
the videodisc, the laser reflective optical system also has the advantage of 
no degradation of the information stored on the disc with extensive use. An 
industrial version was chosen because it would permit the videodisc player 
to be connected to an external computer for its control. The external 
computer, therefore, would contain the program which would control the videodisc 
player. 

A real-time clock was included in the design to afford the capability to 
collect time-based measures of the student's performance. Examples of such 
measures are response latency (the amount of time that the student takes to 
respond to a set of choices) and lesson duration (the amount of time that 
the student takes to complete an entire lesson). 

The use of a touch-panel eliminates the necessity of the student using a 
keyboard to interact with the system. It precludes errors from being made 
during the response process, and it simplifies the man/machine interaction. 

Table 3 (page 25) lists the microcomputers reviewed prior to the 
selection of the computer for the system. As the table indicates, the Apple 
II was the only microcomputer that net the necessary critera. This par- 
ticular microcomputer has the advantage that it can be expanded to a full 64K 
of memory. Most of the other microcomputers reviewed could only be expanded 
to 48K. 
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The decision of which videodisc player to use had already been made by 
the Army Communica rive Technology Office (ACTO), The player that they 
chose was a DiscoVlsion Associates PR-7820, 

An interface board, manufactured by Colony Products, was chosen that 
would Interface the PR-7820 to an Apple II • The board has the capability 
to be used with either of the programming languages, BASIC or Pascal, to 
command the player, and also has the capability to switch the source of 
the video appearing on the monitor to the videodisc player or to the text 
generator of the Apple 11 • 

The clock card that was selected was the Mountain Hardware Clock Card. 
This card permits the time of day and date to be accessed either In Pascal or 
BASIC. This card Is supplied with a rechargeable Nl-Cad battery for back-up 
when power is not supplied to the Apple II, 

Unfortunately, a touch-panel for the Apple II could not be located. 
Consequently, the decision was made to use a light pen In its place. A Symtec 
light pen vras selected for this purpose. The pen also permits use with BASIC 
or Pascal. Table 4 (page 26) Is a review of the devices selected that con- 
stitute the Ideal system, along with a rationale for their selection. 



Table 3 
Hardware Selection 



Necessary Capabilities 
of Microcomputer 



Apple II TRS-80 ATARI 800 EXIDY 



Interface to videodisc player? 



yes 



yes 



yes 



yes 



Switch video between videodisc 
player and computer? 



yes 



yes 



yes 



yes 



NTSC signal out of microcomputer 
character f-enerator? 



yes 



yes 



yes 



yes 



Real-time clock card available? 



yes 



yes 



no 



no 



Light pen available? 



yes 



yes 



no 



no 



Different languages available 
(Pascal, BASIC, FORTRAN)? 



yes 



no 



no 



no 
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Final Hardware 



Device 



Function to be Served 



Apple II Computer 



Will contain the program which will control 
the videodisc player. 



DiscoVision Associates 
PR--7820 Optical- Format 
Videodisc Player 



Will display motion sequences on command 
from the Apple II, 



Symtec Light Pen 



Will permit the student to interact with the 
system by touching the light pen to specific 
positions on the face of the TV monitor. 



Mountain Hardware Real- 
Time Clock Card 



Will allow the capability to collect time- 
based measures of the student's performance • 



Colony Products VAI-i 
Videodisc Interface Board 



Will permit the PR- 7820 to be interfaced to 
the Apple II. Also peinnits the video signal 
to the monitor to be alternated between 
the signal from the videodisc player, and the 
text generator of the Apple II. 



Programming Lang uage 

After the hardware was selected, a review was made of the advantages 
and disadvantages of the various programming languages available for the 
Apple II* This comparison is listed in Table 5 (page 27). Because it is a 
structured language, Par^cal ha'*> an immediate advantage over the other two 
languages, BASIC and FORTRAN. A structured language, by its design, forces 
top-down programming. Simply put, top-down programming requires the pro- 
grammer to define the problem to be programmed before writing the program. A 
structured language also makes the logic of the program easier to follow, 
because procedures must be defined before they are used. Pascal also tends to 
be self documenting. The same cannot be said for either FORTRAN or BASIC. 
Naturally, any language that approaches self-documentation is to be preferred 
over one that does not. In addition, the Apple implementation of Pascal 
allows for user developed procedures to be added to the LIBRARY of the 
language. Consequently, the vocabulary of the language can be expanded for a 
particular set of programs. This feature speeds the development of subsequent 
software in the same application area. Finally, the Apple implementation of 
Pascal permits a program to be broken down into several small segments. Each 
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Table 5 

Comparison of Pascal, BASIC, and FORTRAN 

Pascal BASIC FORTRAN 

Language allows for the expansion of Its 

n ves no no 
vocabulary? 

Language uses computer memory efficiently? yes no yes 

A program written in the language la easily read? yes no no 

Language ^rces "top-down" programming? yes no yes(?) 

A standard exists for the language? yea no yes(?) 
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of the segments can be executed one at a time without the necessity for the 
entire program to be resident In memory at the same time. As a consequence, a 
program much larger than the available memory of the Apple can be executed. 

Software Description 

It Is noteworthy that In this project the software design was developed 
to be complementary to the Instructional design. That Is, the Instructional 
design drove the software and not vice versa. The following discussion 
describes how the software looks to the user. For a more detailed discussion, 
refer to the Functional Software Overview and the Instructions for LAMP, 
Structure, and Transfer (In Appendix K) . The main computer program, called 
Videodisc, produced for this contract Is a general purpose compu ter-asslsted- 
Instructlon (CAI) /videodisc program. The same program Is capable of controlling 
each of the seven videodiscs developed for this project, even though each 
videodisc deals with a different topic area. The program accomplishes this by 
having flexibility designed Into Its structure. That Is, the program was not 
designed to control one videodisc, but rather, was designed to control a 
generalized videodisc. The program assumes that each lesson consists of a 
series of junction points. A junction point Is defined as the collection of 
potential events (text and/or motion sequences) that may occur prior to and 
following the selection of an answer by a student. Because a junction point 
consists of the potential for text and/or motion sequences, the appearance of 
each junction point can be defined Independently of the preceding and/or 
following junction points. Table 6 (page 29) contains the list of events that 
may or may not happen during the execution of a junction point. From an 
Instructional design view, these events can be thought of as options to be 
Included or excluded. Thus, two quite different appearing Instructional modes 
(or more) were made possible from one general program. If all of the potential 
events listed are Included In a lesson, a somewhat traditional CAI lesson 
would be the result. This mode of operation was named the Pedagogical mode 
and has been discussed In depth In a previous section. If event //5 (displaying 
the second motion sequence), event //6 (allowing the student to decide about 
keeping the choice), and event //8 (providing feedback In the form of text) are 
consistently eliminated, another mode of Instruction results. This mode Is 
referred to as the Experiential mode and was also discussed In a previous 
section. In other words, the software was designed to Instantiate the two 
Instructional modes that had been established In the design of the Instructional 
material. This may seem a trivial point, since this is the recommended 
procedure for software development, but it needs to be emphasized because many 
CAI projects seem to develop In the opposite manner. In the following paragraphs 
the Pedagogical and Experiential modes will be reviewed. First, however, a 
brief description will be given of how the program looks to the user before 
one of the two modes Is selected for use. 

When the program Is executed, text Is displayed that Informs the student 
that the videodisc Is being positioned. Next the student has the option 
of viewing the Instructions on the use of the light pen or bypassing the 
Instructions.* If the student doesn^ t respond within 10 sec, then the 



*The remainder of this discussion will assume that a light pen Is In use. If 
a touch-panel Is In use, the student would substitute touching the monitor 
screen with his finger for the light pen. Each of the videodiscs has in- 
structions for both light pen and touch-panel use. 
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Table 6 

Description of Events that Constitute a Junction Point 



Type 



Description 



TEXT 

(From Computer) 



Used to provide background information or to 
provide additional Information to student. 



MOTION SEQUENCE //I 
(From Videodisc) 



Used to present the problem to the student or 
to continue the flow of an interview. 



TEXT 

(From Computer) 



Used to provide additional background infor- 
mation to the student or to provide additional 
Informa tion. 



TEXT 

(From Computer) 



The student Is provided a set of choices (up 
to five) and must select from them. 



MOTION SEQUENCE //2 
(From Videodisc) 



This motion sequence corresponds to the text 
of the selected choice. However, it does not 
show the consequence of the choice and it is 
from the coutii5elor's perspective • 



TEXT 

(From Computer) 



After viewing motion sequence //2 , the student 
is permitted to alter his selection or keep 
the selection. 



MOTION SEQUENCE //3 
(From Videodisc) 



The motion sequence is a repeat of motion 
sequence //3 with the additional information of 
the consequences of the choice. Also, this 
sequence is from the lieutenant's perspective. 
That is, looking at NCO, 



TEXT 

(From Computer) 



Feedback, in the form of text, is presented 
to the student indicating whether this choice 
is the best of those listed. Additional 
information is given explaining the rating 
of this choice. 
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light pen Instructions are automatically presented. To bypass the instructions, 
the student is required to touch the light pen to one of the lines of text on 
the monitor before the 10 sec have elapsed. The student then has the option 
to read an overview of how the lesson will progress. To look at the overview, 
the YES line is touched with the light pen. To bypass the overview, the 
NO line is touched. When appropriate, this YES/NO convention is used in the 
program. Next, the student must enter his or her identification number. This 
is done by touching the pen to the appropriate sections of the screen to enter 
the digits of the service number and then to another line to enter the number, 
NeKt, the student has the option of choosing the Pedagogical or Experiential 
mode. This option, however, can be eliminated by setting one variable in the 
main information file; see the subsection labeled "Information stored In 
record //O of file Point. One" in the Functional Software Overview section of 
Appendix K. If this variable is set, the student will automatically go into 
the Pedagogical mode. 

Once in the Pedagogical mode, the first event Is either a display of 
page(s) of text or the initial motion sequence. If text is present, it is 
used to convey background information of the role to be assumed during the 
lesson. Next, a motion sequence may be displayed. This motion sequence is 
used either to present the problem that the student is to deal with, or to 
continue the flow of an interview as the student progresses through the 
lesson. Additional text may then be presented to give the student more 
background information pertaining to the scenario. Next, the student is asked 
to construct a response regarding what he would do in this situation. Next, 
the student is presented with up to five choices of what he could do in this 
particular situation. He Is asked to choose the alternative that is closest 
to his constructed response or is the best of those given. After he makes 
this choice, he is shown that selection acted out but not Its consequences. 
This was done to avoid any discrepancies in meaning between the text and the 
behavioral portrayal of that answer. When the choice is acted out, it is from 
the perspective of the person being counseled. That is, the student is 
looking at the junior officer. This was done for both role-modeling purposes 
and because it was thought that looking at the lieutenant conveyed less 
information than would be true if the student were shown the counselee^s 
reactions. That is, the alternative is shown without indicating to the 
student whether it is the best of those listed. 

The student is then given the option of keeping his selection or return- 
ing to the set of choices to make another choice. If he decides to keep his 
choice, he is again shown the response acted out along with its consequences. 
In this motion sequence, however, the perspective is that of the young 
officer. That is, the student is looking at the counselee while he hears the 
lieutenant speaking and while the counselee responds; as If the student were 
there. Next, the student is given feedback in the form of text as to whether 
or not this choice was the best of those listed. If it was the best, the 
student is shown a display which permits him to request "help" from the 
computer, look at the consequences of the other choices, repeat the last 
correct response, or continue to the next junction point. The "help" option 
allows the student to move back to earlier junction points or to exit the 
program. The option to look at other choices and their consequences was built 
In to permit the s'tudent to experiment with the other choices after he had 
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made the appropriate choice. The option to repeat the last correct choice was 
included in the event that the student lost the flow of the interview being 
mimicked. If the selection was not the best of those listed, the student Is 
returned to the set of choices which is now minus the incorrect selection. 
That is, if the student picked choice number 1, and it was incorrect, when he 
is returned to the set of choices, choice number 1 will be eliminated. 

The sequence of events listed above continues until the student has 
correctly progressed through the lesson. It should be noted that the student 
is forced to make the appropriate choice before he is advanced to the next 
junction point. Consequently, the student not only sees the correct choice 
acted out, but is also given additional feedback in the form of text as 
to why that choice is considered to be the best of those given. 

As discussed earlier, the Experiential mode of instruction differs from 
the Pedagogical in that the second motion sequence, the opportunity to alter 
the selection made, and the textual feedback are eliminated during the lesson. 
This mode then simulates an interview more closely than does the Pedagogical. 
Up to and including the set of answers being presented, the Pedagogical and 
Experiential modes are identical. However, in the Experiential mode, after a 
choice is made, the student is shown his choice acted out along with the 
consequences of that choice. The perspective during this motion sequence is 
that of the lieutenant. That is, the student is looking at the counselee 
while he hears the lieutenant's response as well as seeing and hearing the 
counselee's reaction. Also, there is no provision for altering the selection. 
The only feedback is given in the counselee^ s reaction. The Experiential 
mode offers the advantage of a more realistic, flowing inteMcnion with the 
possible disadvantage of relying heavily on the acting abilit^ of the sub- 
ordinate to convey adequate feedback about the quality of th? boice made. 
The student progresses until ap end point is reached; when the interaction 
between the lieutenant and the NCO reaches a logical conclusion. When this 
occurs, the student is allowed to return to the beginning of the scenario, 
move back one junction point, repeat the last junction point, or exit the 
program. Table 7 (page 32) is a review of the design differences between the 
two modes of instruction. For a more detailed discussion of the software and 
program listings, see Appendix K. 



Evaluation Design and Results 

Design 

In order to assess the training effectiveness of the VISTA products, the 
videodiscs were evaluated relative to alternative instructional approaches. 
The first decision made concerned the selection of appropriate instructional 
alternatives from which relative measures of effectiveness could be obtained. 
Since the VISTA videodiscs were designed to supplement role playing techniques 
currently being used in the Counseling Laboratory of the Infantry Officer^s 
Basic Course (lOBC), it seemed reasonable to include a control group that 
received role playing. In order to provide uniformity between conditions, the 
Role Play control group received the VISTA scenario topics, role played by 
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Table 7 



Comparison of Pedagogical and Experiential Modes 

Presence of Option 
Pedagogical Experiential 



1. 


Text 


Yes 


Yes 


2. 


Motion Sequence //I 


Yes 


Yes 


3. 


Text 


Yes 


Yes 


k. 


Display Choices and Pick up Response 


Yes 


Yes 


5. 


Motion Sequence //>: 


Yes 


No 


6. 


Allow Student to ,*Tt:^r Choice 


Yes 


No 


7. 


Motion Sequence //3 


Yes 


Yes 


8. 


Display Feedback 


Yes 


No 



the Counseling Laboratory Instructors. Thus, the Inclusion of the Role 
Play condition allowed a comparison of the VISTA products with the current 
Instructional approach. 

Because the Initial costs of the videodisc hardware and development are 
relatively high, It was decided to Include a third condition that received 
exactly the same Instructional Information except at a much reduced fidelity 
and cost. This was accomplished by translating the VISTA scenarios Into a 
programmed textbook format. By Including a Text condition, comparison of 
the effectiveness of a much lower fidelity (along with lower development 
costs) could be made with both the Videodisc and Role Play conditions. 

The major empirical question to be answered In this evaluation Involved 
the relative training effectiveness of the three training conditions (I.e., 
VISTA, Role Play, and Text). In order to evaluate the three modes of Instruc- 
tion, an experimental design was chosen that allowed measurement of both the 
cognitive acquisition of leadership principles and the students'^ subjective 
evaluations of the three approaches. In addition, six different leadership 
content areas were addressed. Because of the limited amount of VISTA equip- 
ment, different lOBC Counseling Laboratory sections were used to test the six 
content areas. The lOBC Counseling Laboratory Is divided Into two sections 
with approximately 100 students per three-hour section. Assignment to each 
section Is random. It was decided to use each section as a "unit" for the 
first and second content areas. Because of time and subject constraints. 
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one-half of a section served as a unit for the third through sixth content 
areas. Table 8 shows the experimental design used for each content area. The 
design shown in Table 8 was repeated six times (once for each content area). 
In the entire effort, three different lOBC classes were used over a period of 
about 10 months. Hence, resulting statistical differences due to "content 
area" could be the result of different classes, different content areas, 
and/or different time of the year. However, this is not a major problem in 
the present effort because such differences are of minimal interest and can be 
statistically controlled. The main question was whether the different modes 
of instruction differentially affected the amount learned and/or if there was 
a significant interaction between mode of Instruction and content area. Such 
an interaction would indicate that the effectiveness of the Instructional mode 
was determined in part by the content area being addressed. 

Subjects (N=312) were randomly assigned to each of the three major 
conditions. At the beginning of each evaluation session the students were 
given a brief explanation of the purpose of the experiment. I.e. i three 
different methods of teaching leadership were being evaluated in order to 
determine the best approach. They were also given an outline of what would 
transpire over the next two hours. The Videodisc and Role Play stations were 
small rooms large enough for groups of seven students and one instructor. The 
size of the groups was set at seven because that Is the size of the groups in 
the current training and also, the probable size of the groups if the VISTA 
program is Implemented. The Text groups were exposed to the programmed texts 
in a large classroom. Once in the Instructional environment, all subjects 
were given 5 min. of instructions and subsequently exposed to their experimental 
condition. For the Videodisc group, instructions and background information 
were presented on the television monitor. For the Text and Role Play groups, 
the ins time tions and background information were read from paper. In the 
Videodisc and Text conditions, the students were exposed to the Pedagogical 
mode of instruction for 35 min. followed by a 15 min. exposure to the Experien- 
tial mode. In the Role Play condition, the students either role played or 
watched others role play for the entire 50 min. 

Following 50 min. of exposure to their major condition, the students were 
tested on what they had learned. The scores on this test were the major 
dependent variable in the experiment. It was decided that a highly structured 
format (e.g., multiple choice, fill In the blank, or short answer), would be 
inappropriate because it would probably be biased In favor of the Videodisc 
and Text conditions, i.e., there was no way of knowing what would be taught in 
the Role Playing situation and, hence, no way of knowing what questions to 
ask. Instead, it was decided to give students an open-ended, unstructured test 
(see Appendix L). Subjects were simply asked three questions. The first 
asked them to list any "principles" they liad learned or been reminded of In 
the last 50 min. about how to deal with people. An example of a principle was 
"If you see a soldier doing an outstanding job, give him recognition". The 
second question asked subjects to list any principles they had learned or been 
reminded of in the last 50 min. about how to better perform their duties. An 
example was "Always make a written record of important meetings.". The third 
question asked the subjects to list any important Army Information or facts 
they had learned or been reminded of In the last 50 min. The example given 
was "The Platoon Leader is responsible for all Issued property that is sub-hand 
receipted from the Company Commander to him." 
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Table 8 



VISTA Evaluation Design 
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Although it Is debatable whether this test Is the best possible test of 
"leadership," funds were not available for a longitudinal analysis. It Is 
argued that regardless of whether students can or do apply the principles of 
leadership, any good Instruction should make the student aware of such 
principles to the extent that he can state them clearly. Also, it is argued 
that this test is not biased in favor of any of the experimental treatments 
because such principles are supposedly being taught in all three approaches. 

The above criterion measure was scored by three independent raters. Two 
of the raters were personnel who had been working on the VISTA project. In 
addition, a third Army Leadership SME who was not familiar with VISTA or group 
identity (the groups were color coded), served as the third judge. One 
point was given for each valid principle or fact. Levels of agreement were 
computed for all combinations of three judges taken two at a time. 

Following the major test, all subjects were given brief, 10-min. ex- 
poGureo to the other two conditions. Thus, all subjects were exposed to all 
three conditions. Also, all possible orders of presentation were given 
(yielding the six groups in Table 8), in order to control for order and 
sequence effects. Following the two brief exposures to their secondary 
conditions, the students were given a preference inventory (see Appendix 
L). In this inventory students were asked to rate on a scale of 1 to 9, their 
subjective opinions on such topics as: (a) how much they thought they had 
learned, (b) how interesting, (c) how motivating, (d) how valuable the three 
instructional approaches were, and (e) how much they agreed with the training 
content. Analyses of variance were performed on measures from each of these 
subjective ratings. 



Resul ts 

Listings of raw data and specific statistical analyses for VISTA content 
areas one through six can be found in Appendix M, Parts one through six. 
Overall statistical analyses for all six content areas can be found in Appendix 
M, Part seven. The two major dependent measures for all content areas were 
scores on the Leadership Principles Test (which served as the measure of 
training effectiveness), and ratings on the subjective preference question- 
naire (which served as a measure of user acceptance). The following two 
sections address the two major dependent measures. 



Uadership Principles Test 

The Leadership Principles Test was graded by three independent judges for 
each of the six content areas. The mean agreement across all combinations of 
three judges taken two at a time for all content areas was 82%. More specific" 
agreement statistics for separate evaluations can be found in Appendix M. The 
mean scores for each of the three instructional mode conditions for all six 
content areas are shown in Figure 5 (page 36). The scores represent the mean 
number of acceptable leadership principles stated in the test for all three 
judges. The means for all three conditions across all six content areas is 
shown in Figure 6 (page 37). A corresponding statistical overview of each 
content area and for all nix content areas collapsed together is shown in 
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Table 9 (page 39). As Indicated, the only content area showing a significant 
x^in effect due to mode of instruction was "Insubordination." Nevman-Keuls 
multiple comparisons tests indicated a statistically significant superiority 
of Videodisc over both Role Playing and Text in "Insubordination." 

An overall Analysis of Variance was conducted on raw scores (means for 
Lhe three judges). The appropriate test was a two factor Analysis of Variance 
with the three modes of Instruction forming the three levels of one factor 
(Mode of Instruction), and the six content areas forming the six levels of the 
second factor (Content Area). As shown in Table 9 (page 39), th^e 
main effect due to Mode of Instruction was significant. A Newman-'^ e^ls 
multiple comparisons test indicated a statistically significant ovei.-ill 
superiority of Videodisc to both the Role Play and Text conditions. Besides 
the significant effect due to Mode of Instruction, the analysis also indicated 
a significant main effect due to Content Area (F (5 ,294)=8 .147, P<.001), and 
Mcric of Instruction by Content Area interaction {? (10,294)=2 ,067, P;=.027) . 
TK^ Content Area effect Indicates that different content areas varied in terms 
o:-: amount of principles reported. Similarly, the significant Interaction 
probably indicates that optimum Instructional mode depended on which content 
area was being taught. In order to remove variability In the data due to 
different topic content all raw scores (mean scores for the three judges) for 
each separate content area were transformed Into T^ scores with a mean of 50 
and a standard deviation of 10. Analysis of Variance on the T scores indicated' 
a significant effect due to Mode of Instruction (£(2,294)=4.633 , P=.01). As 
with the raw scores, a Newman-Keuls multiple comparisons test Indicated a 
statistically significant superiority of the Videodisc condition relative to 
both the Role Play and Text conditions. Also, as with the raw scores, tiier^ 
was no significant difference between the Role Play and Text conditions. Of 
course, there was no effect due to Content Area because of the T score trans- 
formations. The Mode of Instruction by Content Area Interaction was removed 
with the T score transformations (F (10,294)=1.638 , P>.05). 



Subjective Preference Ratings 

On the Leadership Training Preference Test given at the end of the period 
of instruction, students were asked to rate each of the Instructional modes on 
a scale of one to nine as to: (a) hov much they had learned about dealing 
with people, (b) how useful the training was, (c) how It kept their attention, 
(d) how it motivated them, and (e) the quality of the content. A complete 
copy of the Leadership Training Preference Test elong with specific statis- 
tical outcomes for each separate content area and the overall evaluation can 
be found in Appendix M. 'The overall mean ratings averaged across all five 
subjective dimensions and all six content areas are shown in Figure 7 (page 
1+0). Statistical analysis of the overall scores Indicated that the preference 
of Role Play over Videodisc was significant (Newman-Keuls, p><.050). However, 
none of the separate -contetit areas revealed a statistically significant pre- 
ference foL Role Play over Videodisc. Also, the preference of both Role Play 
and Videodisc over the Text condition was highly significant (Newman-Keuls, 
P<.001). Similarly, all of the separate content areas Indicated a highly 
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Table 9 



Statistical Analysis of 
Leadership Principle Test For 
Content Areas 1-6 and Overall 


VISTA 
Content Area 


Main 
Effect 


Role Play 
versus 
Videodisc 
(Newman-Keuls) 


Role Play 
versus 
Text 
(Newman-Keuls) 


Videodisc 
versus 
Text 
(Newman-Keuls) 


//I Verbal 
Abuse 


F(2,87)=2.24 
p=.ll 
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F(2,51)=3.09 
p=.054 


.05<p<.10 
(Vldeodlsc> 
Role Play) 




.05<p<.10 
(VldeodlsO 
Text) 


#3 Meeting 
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and 

Pla toon 


F(2, 35X1.0 








/M Perfor- 
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Counsel- 
ing 


F(2,41)=3.03 
p=.059 


2>.10 


p<.05 
(Role Play> 
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.05<p<.10 
(VldeodlsO 
Text) 
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dination 


F(2,42)=3.85 
jp=.029 


p<.05 
(Vldeodlsc> 
Role Play) 


£>.10 


p<.05 
(Vldeodlsc> 
Text) 


#6 Personal 
Crisis 


F(2, 38X1.0 










OVERALL (1-6) 
RAW SCORES 


F(2,294)« 
5.432 
^.005 


2<.05 
(Vldeodlsc> 
Role Play) 


£>.10 


p<.05 
(Vldeodlsc> 
Text) 


T Scores 


F(2,294) = 
4.633 

£=.01 


£<.C5 
(Videodlsc> 
Role Play) 
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Figure J. VISTA: Overall subjective ratings. 

Note : Overall mean ratings for five questions on which students were asked to 
rate the quality of the three training procedures. 



'40 



58 



statistically significant preference for both Role Play and Vldoedlsc over 
Text (Nevmian-Keuls , jP<,001). When presented with a forced choice question as 
to which approach was the best in terms of learning about Army leadership, 58% 
chose Role Play, 37% chose Videodisc, and 5% chose Text. When presented a 
forced choice question as to which approach best kept their Interest, 54% 
chose Role Pl^y, 46% chose Videodisc, and 2% chose Text. Overall, 90.5% of 
the students felt that the three approaches should be combined with the 
Counseling Laboratory consisting of 17,6% Text, 36,8% Videodisc, and 45.5% 
Role Playing, When asked whether they preferred the Pedagogical or Experiential 
mode of instruction, 70,2% indicated a preference for the Pedagogical mode 
(only the Videodisc subjects were included in this analysis since they were 
the only students with exposure to both modec). This last comparison is 
probably unfair to the Experiential mode since students only received 15 mln. 
of exposure to the Experiential mode while receiving 35 mln. of exposure to 
the Pedagogical mode. Overall, 67.4% Indicated that they thought the two 
Instructional modes should be combined. 

Students were also asked to rate various VISTA quality dimensions on a 
scale of 1 to 9, The four qualitative dimensions were rated relatively high. 
The median for writing was 6.86; the median' for filming was 7.34; the median 
for acting was 6,60; and the median for feedback was 7,38. Finally, the 
students had relatively high agreement with the content of the training for 
both Role Play and Videodisc (mean ratings were 7,29 and 7.24 respectively), 
but a significantly lower agreement with the Text (mean rating was 5.92), The 
disparity between programmed Text and Videodisc was interesting (given that 
the actual content was Identical for the two), and probably reflected a 
general dislike for the programmed text. 



Conclusion and Recommendations 

The major purpose of the VISTA project was to determine if current 
computer-cassis ted videodisc technology could teach soft skills in the Army. 
The evaluarlon results suggest that soft skills can be effectively taught with 
Videodisc technology. One important point needs to be made. In the final 
evaluation, the videodisc programs were matched against both a programmed test 
and role playing in order to make a relative comparison. The results do not 
necessarily imply that the VISTA products should replace role playing and 
wri tten ma terlal for the following reasons. First, the results did Indicate a 
general VISTA superiority overall, but inspection of the separate content 
areas revealed differences in the effectiveness of the videodisc programs on 
different topics. Second, the students indicated a preference for the role 
playing and felt that ideally, the three approaches should be combined. 
Third, the major dependent variable was the score on a cognitive acquisition 
of leadership principles test. It could be argued that a performance test 
such as role playing would have been more appropriate and may have Indicated 
that role playing is the superior method. However, because of time limits tions^, 
it would have been impossible to test evexry student using role playing. Also, 
the traditional problems of obtaining qualified raters, how to structure the 
ratings, and the general unreliability of such measures precluded role playing 
as the dependent variable. Fourth, the VISTA products were never intended to 
replace role playing but rather to supplement role playing. 
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For the above four reasons, It Is suggested that the videodisc products 
should be used In conjunction with role playing and written material. In 
order to demonstrate leadership, one must know the correct solution or 
strategy (cognitive component) and also must be able to carry It out (perform 
mance component). For this reason. It Is suggested that the VISTA products be 
used early In the training (e.g., during the first Counseling Laboratory) , and 
that the more performance-oriented role playing be used later (e.g., during 
the second Counseling Laboratory). 

Because of the success of the VISTA project and other Army videodisc 
projects, it Is recommended that more videodisc tra Ining/ Simula tlon efforts be 
considered. It is very Important that careful front-end analyses be completed 
before trying to apply the new technology (I.e., the videodisc should not be 
considered a general panacea for all training/ Simula tlon areas). In addition, 
the quality of the content must be maintained at a high level (I.e., pre- 
senting poorly written material on a videodisc will not make the material 
accep table) » 

Although the VISTA products were designed for the Infantry Officer^ s 
Basic Course, there may be other potential uses for them. One possibility Is 
a refresher course for Company Commanders. Another possible application Is 
other Offlcer^s Basic Courses. There may be enough similarity between 
leadership problems encountered among different branches that a more general 
distribution Is warranted. This possibility should be examined. 

Further research is currently in progress to develop three additional 
videodisc leadership programs, to develop a trainer^ s manual to determine 
optirr^ group size for training, and to determine If the Pedagogical or 
Expet M>Titlal mode is better. la addition, other training areas are being 
considered by the Army to determine If they would be appropriate domains for 
videodisc. 
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